Speaker-dependent voice-activated camera system

ABSTRACT

A voice-activated camera system for a computing device. The voice-activated camera system includes a processor, a camera module, a speech recognition module and a microphone for accepting user voice input. The voice-activated camera system includes authorized for only a specific user&#39;s voice, so that a camera function may be performed when the authorized user speaks the keyword, but the camera function is not performed when an unauthorized user speaks the keyword.

This application is a continuation of U.S. application Ser. No.14/691,492, filed Apr. 20, 2015 for SPEAKER-DEPENDENT VOICE-ACTIVATEDCAMERA SYSTEM, which is incorporated in its entirety herein byreference.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates generally to cameras, and morespecifically to voice-activated cameras.

2. Discussion of the Related Art

Computing devices, particularly smartphones, typically include at leastone camera. The camera may be controlled through various means,including, for example, a manual shutter button or a user interface ofan application or firmware.

The user interface may include various elements for utilizing thecamera, such as menu selection and keyboard input. Some computing devicecameras may be configured to be operable using voice commands. A voicerecognition system, either located on the computing system or a remotesystem, is typically used for recognizing the words of the speaker andconverting them to computer-readable commands. Voice recognition systemsused with computing systems are generally speaker-independent, i.e., thevoice recognition system recognizes only words and not the identity ofthe individual speaker.

SUMMARY OF THE INVENTION

Several embodiments of the invention advantageously address the needsabove as well as other needs by providing a voice-activated camerasystem, comprising: a computing device including: a processor; a cameramodule coupled to the processor, the camera module configured to executeat least one camera function; a speech recognition module coupled to theprocessor and the camera module, the speech recognition moduleconfigured to identify a user voice input as being from an authorizeduser; and a microphone coupled to at least one of the camera module andthe speech recognition module, whereby the voice-activated camera systemis configured to perform the steps of receive the user voice input viathe microphone, identify whether the user voice input is from theauthorized user; and upon identifying that the user voice input is fromthe authorized user, execute at least one camera function associatedwith the user voice input.

In another embodiment, the invention can be characterized as a methodfor using a voice-activated camera system of a computing device,comprising the steps of: receiving of a user voice input via amicrophone coupled to the camera module; sending of the user voice inputto a speech recognition module of the voice-activated computer system;determining whether the user voice input matches an authorized uservoice; returning to a camera module of the voice-activated camerasystem, upon determining that the user voice input matches theauthorized user voice, a matched indication; returning to the cameramodule, upon determining that the user voice input corresponds to one ofat least one a keyword associated with a camera function, the keyword;performing by the camera module, upon receiving the matched indicationand the keyword, the camera function associated with the key word.

In a further embodiment, the invention may be characterized as a methodfor associating a camera function with a voice command, comprising thesteps of: requesting, by a camera module of a voice-activated camerasystem, of user voice input for a voice-activated camera function;capturing, by a microphone of the voice-activated camera system of theuser voice input; analyzing, by a speech recognition module of thevoice-activated camera system, of the user voice input; storing, by thespeech recognition module, of voice parameters identifying a userassociated with the user voice input; returning to the camera module, bythe speech recognition module, an indication that the user voice inputis associated with the camera function.

In yet another embodiment, the invention may be characterized as amethod for using a voice-activated camera system, comprising the stepsof: associating by the voice-activated camera system of a user voiceinput associated with a camera function and with an authorized user, thevoice-activated camera system including at least a processor, a cameramodule configured to perform at least one camera function, a speechrecognition module, and a microphone; receiving by the microphone of theuser voice input; determining whether the user voice input is associatedwith the authorized user; determining whether the user voice input isassociated with the camera function; performing, upon determining thatthe user voice input is associated with the camera function and with theauthorized user, the camera function.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features and advantages of severalembodiments of the present invention will be more apparent from thefollowing more particular description thereof, presented in conjunctionwith the following drawings.

FIG. 1 is a schematic diagram of a voice-activated camera system in oneembodiment of the present invention.

FIG. 2 is a flowchart diagram of a process for using the voice-activatedcamera system in accordance with one embodiment of the presentinvention.

FIG. 3 is a flowchart diagram of a process for recognizing an authorizeduser of the voice-activated camera system in accordance with oneembodiment of the present invention.

FIG. 4 is a flowchart diagram of a process for storing a camera functioncommand for an authorized user is shown in accordance with anotherembodiment of the present invention.

Corresponding reference characters indicate corresponding componentsthroughout the several views of the drawings. Skilled artisans willappreciate that elements in the figures are illustrated for simplicityand clarity and have not necessarily been drawn to scale. For example,the dimensions of some of the elements in the figures may be exaggeratedrelative to other elements to help to improve understanding of variousembodiments of the present invention. Also, common but well-understoodelements that are useful or necessary in a commercially feasibleembodiment are often not depicted in order to facilitate a lessobstructed view of these various embodiments of the present invention.

DETAILED DESCRIPTION

The following description is not to be taken in a limiting sense, but ismade merely for the purpose of describing the general principles ofexemplary embodiments. The scope of the invention should be determinedwith reference to the claims.

Reference throughout this specification to “one embodiment,” “anembodiment,” or similar language means that a particular feature,structure, or characteristic described in connection with the embodimentis included in at least one embodiment of the present invention. Thus,appearances of the phrases “in one embodiment,” “in an embodiment.” andsimilar language throughout this specification may, but do notnecessarily, all refer to the same embodiment.

Furthermore, the described features, structures, or characteristics ofthe invention may be combined in any suitable manner in one or moreembodiments. In the following description, numerous specific details areprovided, such as examples of programming, software modules, userselections, network transactions, database queries, database structures,hardware modules, hardware circuits, hardware chips, etc., to provide athorough understanding of embodiments of the invention. One skilled inthe relevant art will recognize, however, that the invention can bepracticed without one or more of the specific details, or with othermethods, components, materials, and so forth. In other instances,well-known structures, materials, or operations are not shown ordescribed in detail to avoid obscuring aspects of the invention.

Referring first to FIG. 1, a schematic diagram of a computing device 100including components for operating a voice-activated camera system, isshown in one embodiment of the present invention. Shown are a processor102, a camera module 104, a speech recognition module 106, camerahardware 108, and microphone 110.

As is known in the prior art, the computing device 100 generallyincludes the processor 102 configured to execute software modules. Thesystem shown in FIG. 1 includes the camera module 104, and the speechrecognition module 106, each coupled to the processor 102. It will beapparent to those of ordinary skill in the art that many other softwareand hardware elements may be included in the computing device 100 inaddition to those shown in FIG. 1. The system also includes memorycoupled to the processor 102, modules 104, 106, and other elements asrequired for the operation of the device 100 (not shown).

In some embodiments the computing device is a camera, a smartphone, atablet, a portable media player including a camera, a smartwatchincluding a camera, a video camera, a police body camera, a sportcamera, or an underwater camera.

In the system embodiment shown in FIG. 1, the camera module 104 isconfigured to interface with the processor 102, speech recognitionmodule 106, camera hardware 108, and the microphone 110 as required tocarry out the processes as described herein further below. The cameramodule 104 may also interact with other modules and hardware not shown,for example a keyboard input module to receive keyboard input from auser. In some embodiments, speech recognition module components may beincorporated into the camera module 104.

The speech recognition module 106 in one embodiment is operativelycoupled to the microphone 110 and receives the user voice input toanalyze and store as an authorized voice, or to analyze againstpreviously stored voices. In other embodiments the camera module 104 maybe coupled to the microphone 110 and may receive the user voice inputfrom the microphone 110 and transfer it to the speech recognition module106. In yet other embodiments, the camera module 104 components may beincorporated into the speech recognition module 106. It will beappreciated that other module configurations may also comprise thevoice-activated camera system, provided the system is configured toperform the required actions.

The speech recognition module 106 includes components as required torecord, store and analyze voices to a) identify the speechcharacteristics of at least one authorized voice (i.e. performenrollment for speaker recognition of the authorized user) and b)compare a user voice input to the at least one authorized voice anddetermine whether the user voice input matches the authorized voice,i.e., use speaker-dependent voice recognition to identify the user voiceinput as being from the authorized user. The speech recognition module106 is also configured to output an indication of matching of the uservoice input to the authorized voice and an indication of recognizing atleast one keyword associated with one camera function. In someembodiments, the authorization of a user voice may take place using acamera module user interface of the camera module 104. In otherembodiments, the authorization of the user voice may take place using aspeech recognition user interface of the speech recognition module 106.

The camera module 104 is configured to receive the authorized userindication and the keyword indication from the speech recognition module106. When the camera module 104 receives the authorized user indicationand the keyword indication, the camera module 104 is configured toexecute the camera function associated with the keyword. If the camerareceives only the keyword indication, the camera function is notperformed even if the user voice input includes the correct keywordmatching the camera function.

The camera hardware 108, for example, a shutter and a flash, areoperatively coupled to the camera module 104 for control through thecamera module 104 via voice recognition or other means of user input.

In some embodiments, the voice-activated camera system is accessed viaan application, which may include a user interface specific to theapplication. The application may then access the camera module 104 andspeech recognition module 106 as required. In some embodiments, thevoice-activated camera system runs as a background process, continuouslymonitoring voice input.

Referring next to FIG. 2, a process for using the voice-activated camerasystem to execute the camera function by the authorized user is shown inone embodiment of the present invention. Shown are a receive user voiceinput step 200, a send user voice input step 202, a match authorizeduser decision point 204, a camera function decision point step 206, areturn authorized user indication step 208, a perform camera functionstep 210, a not authorized user step 212, and a function not performedstep 214.

In the first step, the receive user voice input step 200, the cameramodule 104 receives the user voice input associated with a camerafunction via the microphone 110 coupled to the camera module 104. Theprocess then proceeds to the send user voice input step 202.

In the send user voice input step 202, the camera module 104 sends theuser voice input to the speech recognition module 106 for analysis. Theprocess then proceeds to the match authorized user decision point 204.In the match authorized user decision point 204, the speech recognitionmodule 106 analyzes the user voice input and compares the user voiceinput to previously stored voice characteristics for the authorized user(or authorized users, if the system is configured to allow multipleauthorized users). The voice characteristics of the authorized user havepreviously been input to the speech recognition module 106, as outlinedfurther below in FIG. 3, such that the speech recognition module isconfigured to positively identify the authorized user based on speakerrecognition. If the user voice input does not match the authorized user(or any of the authorized users for a plurality of authorized users),i.e. the speech recognition module identifies the user (speaker) voiceand determines that the user is not authorized, the process proceeds tothe not authorized user step 212. If the user voice input matches anauthorized user, the process proceeds to the camera function decisionpoint step 206.

In the not authorized user step 212, the speech recognition module 106returns to the camera module 104 an indication that the user voice inputdoes not correspond to the authorized user, i.e. the characteristics ofthe user voice do not match the characteristics of the authorized user.The process then proceeds to the function not performed step 214. In thefunction not performed step 214, the camera module 104, in response toreceiving the indication that the user is not authorized, does notexecute any camera functions. It will be appreciated that the cameramodule 104 may perform any one of various actions in response to theindication that the user in not authorized, such as returning thedisplay to a general menu, or indicating on the display that the user isnot authorized.

In the camera function decision point step 206 the camera module 104, inresponse to the indication that the user voice input corresponds to theauthorized user, compares the user voice input to keywords associatedwith stored camera functions. If the user voice input consists of orincludes the keyword that matches the associated camera function, theprocess proceeds to the return authorized user indication step 208. Ifthe user voice input does not match one of the keywords, the processthen proceeds to the function not performed step 214, and the cameradoes not execute any camera functions, as previously stated. In the caseof the authorized user, but the keyword not being recognized, the cameramodule 104 may be configured to request another user voice input ordisplay that the voice input was not recognized.

During the return authorized user indication step 2018, the speechrecognition module 106 returns to the camera module 104 the indicationthat the user voice input matches the authorized user. The speechrecognition module 106 also returns the indication of the camerafunction associated with the keyword recognized previously in the camerafunction decision point step 206. The process then proceeds to thecamera function decision point step 206.

In the perform camera function step 210, the camera executes the camerafunction associated with the keyword.

Referring again to FIG. 2, the process for using the camera functions byonly the authorized user prevents unauthorized users from using one ormore camera functions. In one example, the camera module 104 isconfigured to perform the function of taking a photo in response toreceiving the authorized user voice input of the keyword “cheese”. If afirst user has been previously authorized by the speech recognition,when the first user speaks the word “cheese,” the speech recognitionmodule 106 recognizes that the first user is authorized, and returns tothe camera module 104 the authorization indication. The speechrecognition module 106 also recognizes the keyword “cheese”, determinesthat the keyword “cheese” is associated with the camera function oftaking a photo and returns to the camera module 104 the indication thattaking of a photo is the requested camera function. The camera module104 then, in response to the indications, takes the photo.

In some embodiments, the camera module 104 may be configured to performthe camera function if at least one word is spoken by the authorizeduser. For example, if the camera function of taking a photo isassociated with the word “cheese,” the phrase “say cheese” would alsoresult in taking of the photo.

As previously mentioned, in some embodiments the speech recognitionmodule 106 may be configured to authorize more than one user.

In some embodiments, the word or words associated with camera functionsare pre-set. In other embodiments, the camera module 104 may beconfigured to allow the user to change or add to a list of wordsassociated with the camera function.

Referring next to FIG. 3, a process for recognition of an authorizedspeaker is shown in one embodiment of the present invention. Shown are auser requests authorization step 300, a recognize user step 302, and anidentify authorized user step 304

In the initial user requests authorization step 300, the user requestsauthorization as the authorized speaker. In one embodiment, the requestis input through the camera module user interface. The process thenproceeds to the recognize user step 302.

In the recognize user step 302, the speech recognition module 106receives the request for speaker recognition and performs the stepsrequired for being able to recognize the voice of the user. The userspeech recognition steps may vary depending on the type of speechrecognition module 106, and may be done in any way generally known inthe art. The process then proceeds to the identify authorized user step304.

In the next identify authorized user step 304, the speech recognitionmodule 106 stores a user speech indication that the recognized voice isassociated with the authorized user.

Referring again to FIG. 3, one embodiment of associating the user voicewith the authorized user is shown. Those of ordinary skill in the artwill note that additional processes and methods of identifying theauthorized user voice are available. For example, the speech recognitionmodule 106 could be performed by a remote server and a compressedversion of voice identification could be stored in the speechrecognition module 106 in order to reduce local computing demand.

Referring next to FIG. 4, a process for storing a camera functioncommand for the authorized user is shown in another embodiment of thepresent invention. Shown are an initial request user input step 400, acapture voice command step 402, a store voice command data step 404, andan add function command step 406.

In the initial request user input step 400, the camera module 104requests user voice input for associating a voice command, from theauthorized user, with the camera function. In one example, the voicecommand requested may be the word “cheese,” which would be associatedwith the camera function of taking a photo. The process then proceeds tothe capture voice command step 402.

In the capture voice command step 402, the microphone 110 captures theauthorized user speaking the voice command, “cheese,” and sends the uservoice input to the speech recognition module 106. In some embodiments,multiple voice inputs may be requested in order for the speechrecognition module 106 to have enough data to recognize the user'sidentity. The process then proceeds to the store voice command data step404.

During the store voice command data step 404, the speech recognitionmodule 106 analyses the user voice input or inputs and stores the speechparameters necessary to identify the voice command spoken by theauthorized user. The speech recognition module 106, or in someembodiments the camera module 104, also stores the association of thecamera function with the voice command. In this example, the voicecommand “cheese” is associated with the camera function of taking aphoto. The process then proceeds to the add function command step 406.

In the add function command step 406, the camera module 104 adds thevoice command to a list of camera functions available for execution byvoice recognition of the authorized user.

Referring again to FIG. 4, another embodiment of the voice-activatedcamera system uses recognition of specific voice commands in lieu ofrecognition of the authorized user's general voice. In the embodimentshown in FIG. 4, the user calibrates each camera function to theauthorized user speaking the voice command associated with the camerafunction.

In one example, the authorized user wishes to add the voice command“cheese” to the camera function of taking a photo. The authorized usergoes through the process outlined in FIG. 4, after which thevoice-activated camera system is able to recognize specifically theauthorized user speaking the voice command “cheese.” In operation, whenthe authorized user speaks the voice command, the camera module 104 andthe speech recognition module 106 verify the match between theauthorized user speaking the voice command “cheese” and in response thecamera module 104 executes the associated camera function of taking aphoto.

Many of the functional units described in this specification have beenlabeled as modules, in order to more particularly emphasize theirimplementation independence. For example, a module may be implemented asa hardware circuit comprising custom VLSI circuits or gate arrays,off-the-shelf semiconductors such as logic chips, transistors, or otherdiscrete components. A module may also be implemented in programmablehardware devices such as field programmable gate arrays, programmablearray logic, programmable logic devices or the like.

Modules may also be implemented in software for execution by varioustypes of processors. An identified module of executable code may, forinstance, comprise one or more physical or logical blocks of computerinstructions that may, for instance, be organized as an object,procedure, or function. Nevertheless, the executables of an identifiedmodule need not be physically located together, but may comprisedisparate instructions stored in different locations which, when joinedlogically together, comprise the module and achieve the stated purposefor the module.

Indeed, a module of executable code could be a single instruction, ormany instructions, and may even be distributed over several differentcode segments, among different programs, and across several memorydevices. Similarly, operational data may be identified and illustratedherein within modules, and may be embodied in any suitable form andorganized within any suitable type of data structure. The operationaldata may be collected as a single data set, or may be distributed overdifferent locations including over different storage devices, and mayexist, at least partially, merely as electronic signals on a system ornetwork.

While the invention herein disclosed has been described by means ofspecific embodiments, examples and applications thereof, numerousmodifications and variations could be made thereto by those skilled inthe art without departing from the scope of the invention set forth inthe claims.

What is claimed is:
 1. A speaker-dependent voice-activated camerasystem, comprising: a processor; a camera module coupled to theprocessor, the camera module configured to execute a plurality of camerafunctions, wherein each of the plurality of camera functions isassociated with a camera function keyword, and wherein the camera moduleis configured to execute each camera function in response to user input;and a speech recognition module coupled to the processor and the cameramodule, the speech recognition module configured to analyze and storevoice characteristics, receive voice input, and determine, usingpreviously stored voice characteristics, whether received voice input isfrom an authorized user and whether the received voice input includes atleast one camera function keyword, wherein the speech recognition moduleis configured to perform the steps of: receive a first voice input;determine whether the first input is from the authorized user; upondetermining that the first voice input is not from the authorized user,returning to the camera module an unauthorized user indication; upondetermining that the first voice input is from the authorized user,returning to the camera module an authorized user indication anddetermining if the first voice input includes one camera functionkeyword; upon determining that the first voice input does not match onecamera function keyword, returning to the camera module an unmatchedkeyword indication; and upon determining that the first voice inputmatches one camera function keyword, returning to the camera module anindication of the camera function associated with the matched camerafunction keyword, whereby the camera module executes the camera functionassociated with the matched camera function keyword.
 2. Thespeaker-dependent voice-activated camera system of claim 1, the cameramodule further comprising a user interface.
 3. The speaker-dependentvoice-activated camera system of claim 2, wherein upon receiving theunauthorized user indication the camera module indicates to the user,via the user interface, that the first voice input does not match theauthorized user.
 4. The speaker-dependent voice-activated camera systemof claim 3, wherein the indication to the user includes indicating on adisplay of the user interface that the first voice input did not matchthe authorized user.
 5. The speaker-dependent voice-activated camerasystem of claim 3, wherein the indication to the user includes returningthe user interface to a general menu.
 6. The speaker-dependentvoice-activated camera system of claim 2, wherein upon receiving theunmatched keyword indication the camera module indicates to the user,via the user interface, that the first voice input did not include onecamera function keyword.
 7. The speaker-dependent voice-activated camerasystem of claim 6, wherein the indication to the user includesrequesting another voice input.
 8. The speaker-dependent voice-activatedcamera system of claim 6, wherein the indication to the user includesdisplaying that the voice input was not recognized.
 9. A method foroperating a speaker-dependent voice-activated camera system, comprisingthe steps of: receiving of a first voice input by a speech recognitionmodule of the camera system, the speech recognition module configured toanalyze and store voice characteristics, receive voice input, anddetermine, using previously stored voice characteristics, whetherreceived voice input is from an authorized user and whether the receivedvoice input includes at least one camera function keyword; determiningwhether the first input is from the authorized user; upon determiningthat the first voice input is not from the authorized user, returning toa camera module an unauthorized user indication, wherein the cameramodule is coupled to the speech recognition module, and wherein thecameral module configured to execute a plurality of camera functions,wherein each of the plurality of camera functions is associated with acamera function keyword, and wherein the camera module is configured toexecute each camera function in response to user input; upon determiningthat the first voice input is from the authorized user, returning to thecamera module an authorized user indication and determining if the firstvoice input includes one camera function keyword; upon determining thatthe first voice input does not match one camera function keyword,returning to the camera module an unmatched keyword indication; and upondetermining that the first voice input matches one camera functionkeyword, returning to the camera module an indication of the camerafunction associated with the matched camera function keyword, wherebythe camera module executes the camera function associated with thematched camera function key word.
 10. The method for operating thespeaker-dependent voice-activated camera system of claim 12, the cameramodule further comprising a user interface.
 11. The method for operatingthe speaker-dependent voice-activated camera system of claim 13, whereinupon receiving the unauthorized user indication the camera moduleindicates to the user, via the user interface, that the first voiceinput does not match the authorized user.
 12. The method for operatingthe speaker-dependent voice-activated camera system of claim 4, whereinthe indication to the user includes indicating on a display of the userinterface that the first voice input did not match the authorized user.13. The method for operating the speaker-dependent voice-activatedcamera system of claim 4, wherein the indication to the user includesreturning the user interface to a general menu.
 14. Thespeaker-dependent voice-activated camera system of claim 3, wherein uponreceiving the unmatched keyword indication the camera module indicatesto the user, via the user interface, that the first voice input did notinclude one camera function key word.
 15. The speaker-dependentvoice-activated camera system of claim 7, wherein the indication to theuser includes requesting another voice input.
 16. The speaker-dependentvoice-activated camera system of claim 7, wherein the indication to theuser includes displaying that the voice input was not recognized.
 17. Amethod for associating a camera function with a voice command,comprising the steps of: capturing, by a microphone, at least one voiceinput from an authorized speaker, each at least one voice inputincluding a keyword; sending, by the microphone coupled to a speechrecognition module of the voice-activated camera system, the at leastone voice input; determining, by the speech recognition module from theat least one voice input, of a plurality of speech parameters whereinthe plurality of speech parameters are sufficient to determine whetherthe keyword has been spoken by the authorized user; storing, by thespeech recognition module, of the plurality of speech parameters; andstoring, by the speech recognition module, of an association of theplurality of speech parameters with a camera function, whereby thespeech recognition module, upon receiving a command voice input andcomparing the command voice input to the plurality of speech parameters,is configured to determine if the command voice input includes thekeyword spoken by the authorized user.
 18. The method for associatingthe camera function with the voice command of claim 17, furthercomprising the step of, prior to capturing the at least one input, ofrequesting, by a camera module coupled to the speech recognition moduleand the microphone, of the user voice input.
 19. The method forassociating the camera function with the voice command of claim 17,further comprising the step of sending, to a camera module coupled tothe speech recognition module, of the association of the plurality ofspeech parameters with the camera function to a camera module coupled tothe speech recognition module.
 20. The method for associating the camerafunction with the voice command of claim 19, further comprising the stepof adding, by the camera module, of the keyword to a list of camerafunctions available for execution by voice recognition by the user.